5. Phase Transitions 



A phase transition is an abrupt, discontinuous change in the properties of a system. 
We've aheady seen one example of a phase transition in our discussion of Bose- Einstein 
condensation. In that case, we had to look fairly closely to see the discontinuity: it was 
lurking in the derivative of the heat capacity. In other phase transitions — many of 
them already familiar — the discontinuity is more manifest. Examples include steam 
condensing to water and water freezing to ice. 

In this section we'll explore a couple of phase transitions in some detail and extract 
some lessons that are common to all transitions. 



5.1 Liquid-Geis Transition 



Recall that we derived the van der Waals equation of state for a gas (2.31) in Section 
2.5. We can write the van der Waals equation as 
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(5.1) 



where v = V/N is the volume per particle. In the literature, you will also see this 
equation written in terms of the particle density p = 1/v. 

On the right we fix T at different val- 
ues and sketch the graph of p vs. V deter- 
mined by the van der Waals equation. These 
curves are isotherms — line of constant tem- 
perature. As we can see from the diagram, 
the isotherms take three different shapes de- 
pending on the value of T. The top curve 
shows the isotherm for large values of T. Here 
we can effectively ignore the —a/v^ term. (Re- 
call that V cannot take values smaller than 
6, refiecting the fact that atoms cannot ap- 
proach to arbitrarily closely). The result is a monotonically decreasing function, essen- 
tially the same as we would get for an ideal gas. In contrast, when T is low enough, the 
second term in (5.1) can compete with the first term. Roughly speaking, this happens 
when ksT ~ a/f is in the allowed region v > b. For these low value of the temperature, 
the isotherm has a wiggle. 
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Figure 35: 
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At some intermediate temperature, the wiggle must flatten out so that the bottom 
curve looks like the top one. This happens when the maximum and minimum meet 
to form an inflection point. Mathematically, we are looking for a solution to dp/dv — 
d'^p/dv'^ — 0. it is simple to check that these two equations only have a solution at the 
critical temperature T — Tc given by 

ksT. = ^ (8-2) 

Let's look in more detail at the T < Tc curve. For a range of pressures, the system can 
have three different choices of volume. A typical, albeit somewhat exagerated, example 
of this curve is shown in the figure below. What's going on? How should we interpret 
the fact that the system can seemingly hve at three different densities p— l/v7 



PA 




First look at the middle solution. This has 
some fairly weird properties. We can see from the 
graph that the gradient is positive: dp/dv\j. > 0. 
This means that if we apply a force to the con- 
tainer to squeeze the gas, the pressure decreases. 
The gas doesn't push back; it just relents. But if 
we expand the gas, the pressure increases and the 
gas pushes harder. Both of these properties are 

Figure 36: 

telhng us that the gas in that state is unstable. 

If we were able to create such a state, it wouldn't hand around for long because any 
tiny perturbation would lead to a rapid, explosive change in its density. If we want to 
find states which we are likely to observe in Nature then we should look at the other 
two solutions. 

The solution to the left on the graph has v shghtly bigger than h. But, recall from 
our discussion of Section 2.5 that h is the closest that the atoms can get. If we have 
V b, then the atoms are very densely packed. Moreover, we can also see from the 
graph that \dp/dv\ is very large for this solution which means that the state is very 
difficult to compress: we need to add a great deal of pressure to change the volume 
only slightly. We have a name for this state: it is a liquid. 

You may recall that our original derivation of the van der Waals equation was valid 
only for densities much lower than the liquid state. This means that we don't really 
trust (5.1) on this solution. Nonetheless, it is interesting that the equation predicts 
the existence of liquids and our plan is to gratefully accept this gift and push ahead 
to explore what the van der Waals tells us about the liquid-gas transition. We will see 
that it captures many of the quahtative features of the phase transition. 
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The last of the three solutions is the one on the right in the figure. This solution has 
V ^ b and small \dp/dv\. It is the gas state. Our goal is to understand what happens 
in between the liquid and gas state. We know that the naive, middle, solution given to 
us by the van der Waals equation is unstable. What replaces it? 

5.1.1 Phcise Equilibrium 

Throughout our derivation of the van der Waals equation in Section 2.5, we assumed 
that the system was at a fixed density. But the presence of two solutions — the liquid 
and gas state — allows us to consider more general configurations: part of the system 
could be a liquid and part could be a gas. 

How do we figure out if this indeed happens? Just because both liquid and gas states 
can exist, doesn't mean that they can cohabit. It might be that one is preferred over 
the other. We already saw some conditions that must be satisfied in order for two 
systems to sit in equilibrium back in Section 1. Mechanical and thermal equilibrium 
are guaranteed if two systems have the same pressure and temperature respectively. 
But both of these are already guaranteed by construction for our two liquid and gas 
solutions: the two solutions sit on the same isotherm and at the same value of p. We're 
left with only one further requirement that we must satisfy which arises because the 
two systems can exchange particles. This is the requirement of chemical equilibrium, 

A* liquid = A'gas (^-3) 

Because of the relationship (4.22) between the chemical potential and the Gibbs free 
energy, this is often expressed as 

S-liquid = S-gas (5.4) 

where g — G/N is the Gibbs free energy per particle. 

Notice that all the equilibrium conditions involve only intensive quantities: p, T and 
This means that if we have a situation where liquid and gas are in equilibrium, then 
we can have any number A^uquid of atoms in the liquid state and any number N^g^ in 
the gas state. But how can we make sure that chemical equilibrium (5.3) is satisfied? 

Maxwell Construction 

We want to solve /iuquid = /^gas- We will think of the chemical potential as a function of 
p and T: 11 = /j{p,T). Importantly, we won't assume that fi{p,T) is single valued since 
that would be assuming the result we're trying to prove! Instead we will show that if 
we fix T, the condition (5.3) can only be solved for a very particular value of pressure 
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dp 



p. To see this, start in the hquid state at some fixed value of p and T and travel along 
the isotherm. The infinitesimal change in the chemical potential is 

dp 

However, we can get an expression for dfi/dp by recalling that arguments involving 
extensive and intensive variables tell us that the chemical potential is proportional to 
the Gibbs free energy: G{p,T,N) = fi{p,T)N (4.22). Looking back at the variation of 
the Gibbs free energy (4.21) then tells us that 



dG 
dp 



(9/i 
dp 



N = V 



(5.5) 



Integrating along the isotherm then tells us the chem- 
ical potential of any point on the curve. 



/i(p,T) = /iiiquid + / dp' 

Pliquid 
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When we get to gas state at the same pressure p = 
Piiquid that we started from, the condition for equi- 
librium is yU = /iiiquid- Which means that the integral Figure 37: 
has to vanish. Graphically this is very simple to de- 
scribe: the two shaded areas in the graph must have equal area. This condition, known 
as the Maxwell construction, tells us the pressure at which gas and liquid can co-exist. 

I should confess that there's something slightly dodgy about the Maxwell construc- 
tion. We already argued that the part of the isotherm with dp/dv > suffers an 
instability and is unphysical. But we needed to trek along that part of the curve to 
derive our result. There are more rigorous arguments that give the same answer. 

For each isotherm, we can determine the pressure at which the liquid and gas states 
are in equilibrium. The gives us the co- existence curve, shown by the dotted line in 
Figure 38. Inside this region, liquid and gas can both exist at the same temperature 
and pressure. But there is nothing that tells us how much gas there should be and how 
much liquid: atoms can happily move from the liquid state to the gas state. This means 
that while the density of gas and liquid is fixed, the average density of the system is 
not. It can vary between the gas density and the liquid density simply by changing the 
amount of liquid. The upshot of this argument is that inside the co-existence curves, 
the isotherms simply become fiat lines, refiecting the fact that the density can take any 
value. This is shown in graph on the right of Figure 38. 
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Figure 38: The co-existence curve in red, resulting in constant pressure regions consisting 
of a harmonious mixture of vapour and hquid. 



To illustrate the physics of this situation, suppose that we sit 
at some fixed density p = 1/v and cool the system down from a 
high temperature to T < Tc at a point inside the co-existence curve 
so that we're now sitting on one of the fiat lines. Here, the system 
is neither entirely liquid, nor entirely gas. Instead it will split into 
gas, with density 1/fgas, and liquid, with density l/fuquid so that the 
average density remains 1/v. The system undergoes phase separation. 
The minimum energy configuration will typically be a single phase of 
liquid and one of gas because the interface between the two costs energy. (We will 
an expression for this energy in Section 5.5). The end result is shown on the rig 
the presence of gravity, the higher density liquid will indeed sink to the bottom. 




Figure 39: 
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Meta-Stable States 

We've understood what replaces the unstable region 
of the van der Waals phase diagram. But we seem to have 
removed more states than anticipated: parts of the Van 
der Waals isotherm that had dp/dv < are contained in 
the co-existence region and replaced by the fiat pressure 
lines. This is the region of the p-V phase diagram that 
is contained between the two dotted lines in the figure to 
the right. The outer dotted line is the co-existence curve. 
The inner dotted curve is constructed to pass through the 
stationary points of the van der Waals isotherms. It is 
called the spinodial curve. 




Figure 40: 



- 138 - 



The van dcr Waals states which he between the spinodial curve and the co-existence 
curve are good states. But they are meta-stable. One can show that their Gibbs free 
energy is higher than that of the hquid-gas equihbrium at the same p and T. However, 
if we compress the gas very slowly we can coax the system into this state. It is known 
as a supercooled vapour. It is delicate. Any small disturbance will cause some amount 
of the gas to condense into the liquid. Similarly, expanding a liquid beyond the co- 
existence curve results in an meta-stable, superheated liquid. 



5.1.2 The Clausius-Clapeyron Equation 

We can also choose to plot the liquid-gas phase dia- 
gram on the p — T plane. Here the co-existence region is 
squeezed into a line: if we're sitting in the gas phase and 
increase the pressure just a little bit at at fixed T < 
then we jump immediately to the liquid phase. This ap- 
pears as a discontinuity in the volume. Such discontinu- 
ities are the sign of a phase transition. The end result 
is sketched in the figure to the right; the thick solid line 
denotes the presence of a phase transition. 



critical point 




Figure 41: 



Either side of the line, all particles are either in the gas or liquid phase. We know 
from (5.4) that the Gibbs free energies of these two states are equal, 

^liquid ^gas 

So G is continuous as we move across the line of phase transitions. Suppose that we 
sit on the hne itself and move up it. How does G change? We can easily compute this 
from (4.21), 

C^Cliquid = —SliquiddT + liquid C^P 



dG 



gas 



-SgasdT + V„asdp 



But this gives us a nice expression for the slope of the line of phase transitions in the 
p-T plane. It is 



dp 5'gas - S] 



liquid 



dT V^as liquid 



We usually define the latent heat 



L — T(5'gas >S'iiquid) 
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This is the energy released as we pass through the phase transition. We see that the 
slope of the line in the p-T plane is determined by the ratio of latent heat released 
in the phase transition and the discontinuity in volume . The result is known as the 
Clausius-Clapeyron equation, 

dp L 



liquid ) 



(5.6) 



There is a classification of phase transitions, due originally to Ehrenfest. When the 
^th (derivative of a thermodynamic potential (either F or G usually) is discontinuous, 
we say we have an n*^ order phase transition. In practice, we nearly always deal with 
first, second and (very rarely) third order transitions. The liquid-gas transition releases 
latent heat, which means that S — —dF/dT is discontinuous. Alternatively, we can 
say that V = dG/dp is discontinuous. Either way, it is a first order phase transition. 
The Clausius-Clapeyron equation (5.6) applies to any first order transition. 

As we approach T — > Tc, the discontinuity dimin- 
ishes and -S'liquid — ^ 'S'gas. At the critical point T — Tc we 
have a second order phase transition. Above the critical 
point, there is no sharp distinction between the gas phase 
and liquid phase. 

For most simple materials, the phase diagram above is 
part of a larger phase diagram which includes solids at 
smaller temperatures or higher pressures. A generic ver- 
sion of such a phase diagram is shown to the right. The 
van der Waals equation is missing the physics of solidifica- 
tion and includes only the liquid-gas line. 




Figure 42: 



An Approximate Solution to the Clausius-Clapeyron Equation 

We can solve the Clausius-Clapeyron solution if we make the following assumptions: 

• The latent heat L is constant. 

• Vgas ^ ^liquid, SO V^as — ^liquid ~ Vgas- For Water, this is an error of less than 0.1% 

• Although we derived the phase transition using the van der Waals equation, now 
we've got equation (5.6) we'll pretend the gas obeys the ideal gas law pV — NksT. 

With these assumptions, it is simple to solve (5.6). It reduces to 

dP Lp 



dT NksT 
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-L/keT 
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5.1.3 The Critical Point 

Let's now return to discuss some aspects of life at the critical point. We previously 
worked out the critical temperature (5.2) by looking for solutions to simultaneous equa- 
tions dp/dv = d^p/dv'^ = 0. There's a slightly more elegant way to find the critical 
point which also quickly gives us Pc and Vc as well. We rearrange the van der Waals 
equation (5.1) to get a cubic, 

pv^ - (pb + kBT)v'^ + av-ab^O 

For T < Tc, this equation has three real roots. For T > there is just one. Precisely at 
T — Tc, the three roots must therefore coincide (before two move off onto the complex 
plane). At the critical point, this curve can be written as 

Pc{v - Vcf = 

Comparing the coefficients tells us the values at the critical point, 

^^^^ = Wh ' ^^^^^ ' ^^=2^ ^^-^^ 
The Law of Corresponding States 

We can invert the relations (5.7) to express the parameters a and h in terms of the 
critical values, which we then substitute back into the van der Waals equation. To this 
end, we define the reduced variables, 

Tc Vc Pc 

The advantage of working with T, v and p is that it allows us to write the van der 
Waals equation (5.1) in a form that is universal to all gases, usually referred to as the 
law of corresponding states 



Sv-l/S v2 

Moreover, because the three variables Tc, Pc and v^. at the critical point are expressed 
in terms of just two variables, a and b (5.7), we can construct a combination of them 
which is independent of a and b and therefore supposedly the same for all gases. This 
is the universal compressibility ratio, 

^ = ^ = 0.375 (5.8) 
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Figure 43: The coexistence curve for gases. Data is plotted for Ne, Ar, Kr,Xe, N2, O2, CO 
and CH4. 

Comparing to real gases, this number is a little high. Values range from around 
0.28 to 0.3. We shouldn't be too discouraged by this; after all, we knew from the 
beginning that the van der Waals equation is unlikely to be accurate in the liquid 
regime. Moreover, the fact that gases have a critical point (defined by three variables 
Tc, Pc and Vc) guarantees that a similar relationship would hold for any equation of 
state which includes just two parameters (such as a and b) but would most likely fail 
to hold for equations of state that included more than two parameters. 

Dubious as its theoretical foundation is, the law of corresponding states is the first 
suggestion that something remarkable happens if we describe a gas in terms of its 
reduced variables. More importantly, there is striking experimental evidence to back 
this up! Figure 43 shows the Guggenheim plot, constructed in 1945. The co-existence 
curve for 8 different gases in plotted in reduced variables: T along the vertical axis; 
p = 1/v along the horizontal. The gases vary in complexity from the simple monatomic 
gas Ne to the molecule Cif4. As you can see, the co-existence curve for all gases is 
essentially the same, with the chemical make-up largely forgotten. There is clearly 
something interesting going on. How to understand it? 

Critical Exponents 

We will focus attention on physics close to the critical point. It is not immediately 
obvious what are the right questions to ask. It turns out that the questions which 
have the most interesting answer are concerned with how various quantities change as 
we approach the critical point. There are lots of ways to ask questions of this type 
since there are many quantities of interest and, for each of them, we could approach 
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the critical point from different directions. Here we'll look at the behaviour of three 
quantities to get a feel for what happens. 



First, we can ask what happens to the difference in (inverse) densities Vgas — fuquid as 
we approach the critical point along the co-existence curve. For T < Tc, or equivalently 
T < 1, the reduced van der Waals equation (5.8) has two stable solutions, 



P 



8T 3 8T 



If we solve this for T, we have 

(SVliquid - l)(3t^gas - l)(^^liquid + ^^gas) 



8'^gas'^Uquid 



Notice that as we approach the critical point, Vgas, t'uquid 1 and the equation above 
tells us that T — > 1 as expected. We can see exactly how we approach T = 1 by 
expanding the right right-hand side for small e = Vggg — ■uuquid- To do this quickly, it's 
best to notice that the equation is symmetric in Vgas and t^uquidj so close to the critical 
point we can write Wgas = 1 + e/2 and wuquid = 1 — e/2. Substituting this into the 
equation above and keeping just the leading order term, we find 

T ^ 1 — — (Vgas — 'illiquid) 

Or, re-arranging, as we approach Tc along the co-existence curve, 

^ga.-^^liquid~ (7;-r)'/' (5.9) 



This is the answer to our first question. 



Our second variant of the question is: how does the volume change with pressure 
as we move along the critical isotherm. It turns out that we can answer this question 
without doing any work. Notice that at T = Tc, there is a unique pressure for a given 
volume p{v,Tc). But we know that dp/dv — d'^p/dv^ = at the critical point. So a 
Taylor expansion around the critical point must start with the cubic term, 

p-Pc^{v-Vc)^ (5.10) 



This is the answer to our second question. 
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Our third and final variant of the question concerns the compressibility, defined as 

1 dv , , 

« = — — 5.11 
V op J, 

We want to understand how k changes as we approach T ^ Tc from above. In fact, we 
met the compressibility before: it was the feature that first made us nervous about the 
van der Waals equation since k, is negative in the unstable region. We already know 
that at the critical point dp/dv\j,^ — 0. So expanding for temperatures close to Tc, we 
expect 

dp 
dv 



^-a{T-T,) + ... 

T;v=Vc 



This tells us that the compressibihty should diverge at the critical point, scaling as 

«:~(T-r,)-i (5.12) 

We now have three answers to three questions: (5.9), (5.10) and (5.12). Are they 
right?! By which 1 mean: do they agree with experiment? Remember that we're not 
sure that we can trust the van der Waals equation at the critical point so we should be 
nervous. However, there is also reason for some confidence. Notice, in particular, that 
in order to compute (5.10) and (5.12), we didn't actually need any details of the van 
der Waals equation. We simply needed to assume the existence of the critical point 
and an analytic Taylor expansion of various quantities in the neighbourhood. Given 
that the answers follow from such general grounds, one may hope that they provide 
the correct answers for a gas in the neighbourhood of the critical point even though we 
know that the approximations that went into the van der Waals equation aren't valid 
there. Fortunately, that isn't the case: physics is much more interesting than that! 

The experimental results for a gas in the neighbourhood of the critical point do share 
one feature in common with the discussion above: they are completely independent of 
the atomic make-up of the gas. However, the scaling that we computed using the van 
der Waals equation is not fully accurate. The correct results arc as follows. As we 
approach the critical point along the co-existence curve, the densities scale as 

^^gas - ^^liquid ~ (Tc - T)^ with (3^0.32 

(Note that the exponent P has nothing to do with inverse temperature. We're just near 
the end of the course and running out of letters and (3 is the canonical name for this 
exponent). As we approach along an isotherm, 

P —Pc ^ {'V — VcY with 5 4.8 
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Finally, as we approach Tc from above, the compressibility scales as 

«;~(T-Te)~^ with 7 f^i 1.2 

The quantities (3, 7 and 6 are examples of critical exponents. We will see more of them 
shortly. The van der Waals equation provides only a crude first approximation to the 
critical exponents. 

Fluctuations 

We see that the van der Waals equation didn't do too badly in capturing the dynamics 
of an interacting gas. It gets the qualitative behaviour right, but fails on precise 
quantitative tests. So what went wrong? Wc mentioned during the derivation of the 
van der Waals equation that we made certain approximations that are valid only at 
low density. So perhaps it is not surprising that it fails to get the numbers right near 
the critical point v — 36. But there's actually a deeper reason that the van der Waals 
equation fails: fluctuations. 

This is simplest to see in the grand canonical ensemble. Recall that back in Section 
1 that we argued that AN/N ~ 1/\/N, which allowed us to happily work in the 
grand canonical ensemble even when we actually had fixed particle number. In the 
context of the liquid-gas transition, fluctuating particle number is the same thing as 
fluctuating density p — N/V. Let's revisit the calculation of AA^" near the critical 
point. Using (1.45) and (1.48), the grand canonical partition function can be written 
as logZ — —pVp{T,ii), so the average particle number (1.42) is 



{N) = V 



dp 



We already have an expression for the variance in the particle number in (1.43), 
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Dividing these two expressions, we have 
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But we can re-write this expression using the general relationship between partial 
derivatives dx/dy\^ dy/dz\^ dz/dx\y — —1. We then have 

AN^ 
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This final expression relates the fluctuations in the particle number to the compress- 
ibility (5.11). But the compressibility is diverging at the critical point and this means 
that there are large fluctuations in the density of the fluid at this point. The result is 
that any simple equation of state, like the van der Waals equation, which works only 
with the average volume, pressure and density will miss this key aspect of the physics. 

Understanding how to correctly account for these fluctuations is the subject of critical 
phenomena. It has close links with the renormalization group and conformal field theory 
which also arise in particle physics and string theory. You will meet some of these ideas 
in next year's Statistical Field Theory course. Here we will turn to a different phase 
transition which will allow us to highlight some of the key ideas. 

5.2 The Ising Model 

The Ising model is one of the touchstones of modern physics; a simple system that 
exhibits non-trivial and interesting behaviour. 

The Ising model consists of N sites in a d-dimensional lattice. On each lattice site 
lives a quantum spin that can sit in one of two states: spin up or spin down. We'll call 
the eigenvalue of the spin on the i*^ lattice site Sj. If the spin is up, Sj = if the spin 
is down. Si — —1. 

The spins sit in a magnetic field that endows an energy advantage to those which 
point up, 

N 

1=1 

(A comment on notation: B should be properly denoted H. We're sticking with B to 
avoid confusion with the Hamiltonian. There is also a factor of the magnetic moment 
which has been absorbed into the definition of B) . The lattice system with energy Eb 
is equivalent to the two-state system that we first met when learning the techniques of 
statistical mechanics back in Section 1.2.3. However, the Ising model contains an addi- 
tional complication that makes the sysem much more interesting: this is an interaction 
between neighbouring spins. The full energy of the system is therefore, 

E ^ -J^s^Sj - B^Si (5.13) 

The notation (ij) means that we sum over all "nearest neighbour" pairs in the lattice. 
The number of such pairs depends both on the dimension d and the type of lattice. 
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We'll denote the number of nearest neighbours as q. For example, in d = 1 a lattice 
has g = 2;in(i=2,a square lattice has g = 4. A square lattice in d dimensions has 
q = 2d. 

If J > 0, neighbouring spins prefer to be aligned (ft or H). In the context of 
magnetism, such a system is called a ferromagnet. If J < 0, the spins want to anti- 
align (ti)- This is an anti-ferromagnet. In the following, we'll choose J > although 
for the level of discussion needed for this course, the differences are minor. 

We work in the canonical ensemble and introduce the partition function 

Z = J]e-^^W (5.14) 

{Si} 

While the effect of both J > and 5 7^ is to make it energetically preferable for the 
spins to align, the effect of temperature will be to randomize the spins, with entropy 
winnning out over energy. Our interest is in the average spin, or average magnetization 

1 V^/ \ 1 d\ogZ 

i 

The Ising Model as a Lattice Gas 

Before we develop techniques to compute the partition function (5.14), it's worth point- 
ing out that we can drape slightly different words around the mathematics of the Ising 
model. It need not be interpreted as a system of spins; it can also be thought of as a 
lattice description of a gas. 

To see this, consider the same d-dimensional lattice as before, but now with particles 
hopping between lattice sites. These particles have hard cores, so no more than one 
can sit on a single lattice site. We introduce the variable rii G {0, 1} to specify whether 
a given lattice site, labelled by i, is empty (n^ = 0) or filled (n^ = 1). We can also 
introduce an attractive force between atoms by offering them an energetic reward if 
they sit on neighbouring sites. The Hamiltonian of such a lattice gas is given by 

E = —4 J riiUj — fi rii 

where is the chemical potential which determines the overall particle number. But this 
Hamiltonian is trivially the same as the Ising model (5.13) if we make the identification 

Si = 2ni-le {-1,1} 

The chemical potenial /i in the lattice gas plays the role of magnetic field in the spin 
system while the magnetization of the system (5.15) measures the average density of 
particles away from half-filling. 
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5.2.1 Mean Field Theory 

For general lattices, in arbitrary dimension d, the sum (5.14) cannot be performed. An 
exact solution exists in = 1 and, when = 0, in = 2. (The d = 2 solution is 
originally due to Onsager and is famously complicated! Simpler solutions using more 
modern techniques have since been discovered). 

Here we'll develop an approximate method to evaluate Z known as mean field theory. 
We write the interactions between neighbouring spins in term of their deviation from 
the average spin m, 

SiSj = [(sj — m)+ m\)[{sj — m)+m] 

— {si — m) {sj —171)+ m{sj — m) + m{si — m) + 

The mean field approximation means that we assume that the fluctuations of spins away 
from the average are small which allows us to neglect the flrst term above. Notice that 
this isn't the statement that the variance of an individual spin is small; that can never 
be true because Sj takes values +1 or —1 so {sf) ~ 1 and the variance ((sj — mf) is 
always large. Instead, the mean field approximation is a statement about fluctuations 
between spins on neighbouring sites, so the flrst term above can be neglected when 
summing over then write the energy (5.13) as 

= ]-JNqm^ - {Jqm + B)^Si (5.16) 

i 

where the factor of Nq/2 in the flrst term is simply the number of nearest neighbour 
pairs X^(jj)- The factor or 1/2 is there because Xl(jj) ^ sVim. over pairs rather than a 
sum of individual sites. (If you're worried about this formula, you should check it for 
a simple square lattice in o? = 1 and d = 2 dimensions). A similar factor in the second 
term cancelled the factor of 2 due to (sj + Sj). 

We see that the mean fleld approximation has removed the interactions. The Ising 
model reduces to the two state system that we saw way back in Section 1. The result 
of the interactions is that a given spin feels the average effect of its neighbour's spins 
through a contribution to the effective magnetic fleld, 

— B + Jqm 

Once we've taken into account this extra contribution to B^s, each spin acts indepen- 
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Figure 44: tanh( Jgm/?) for JqP < 1 



Figure 45: tanh( for Jq(5 > 1 



dently and it is easy to write the partition function. It is 

= e-^^''^^"^'2^ cosh^ /?Seff (5.17) 

However, we're not quite done. Our result for the partition function Z depends on B^s 
which depends on m which we don't yet know. However, we can use our expression for 
Z to self-consistently determine the magnetization (5.15). We find, 

m = tanh(/35 + pjqm) (5.18) 

We can now solve this equation to find the magnetization for various values of T and B: 
m — m{T, B). It is simple to see the nature of the solutions using graphical methods. 

B=0 

Let's first consider the situation with vanishing magnetic field, 5 = 0. The figures 
above show the graph linear in m compared with the tanh function. Since tanha; ~ 
X— ■ the slope of the graph near the origin is given by jdJq. This then determines 

the nature of the solution. 

• The first graph depicts the situation for f3Jq < 1. The only solution is m = 0. 
This means that at high temperatures ksT > Jq, there is no average magne- 
tization of the system. The entropy associated to the random temperature fiu- 
cutations wins over the energetically preferred ordered state in which the spins 
align. 

• The second graph depicts the situation for f3Jq > 1. Now there are three solu- 
tions: m = ±mo and m = 0. It will turn out that the middle solution, m = 0, is 
unstable. (This solution is entirely analogous to the unstable solution of the van 
der Waals equation. We will see this below when we compute the free energy). 
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For the other two possible solutions, m = ±mo, the magnetization is non-zero. 
Here we see the effects of the interactions begin to win over temperature. Notice 
that in the limit of vanishing temperature, /5 — > oo, mg 1. This means that all 
the spins are pointing in the same direction (either up or down) as expected. 

• The critical temperature separating these two cases is 

= Jq (5.19) 

The results described above are perhaps rather surprising. Based on the intuition that 
things in physics always happen smoothly, one might have thought that the magneti- 
zation would drop slowly to zero as T ^ oo. But that doesn't happen. Instead the 
magnetization turns off abruptly at some finite value of the temperature T = Tc, with 
no magnetization at all for higher temperatures. This is the characteristic behaviour 
of a phase transition. 

For B ^ 0, we can solve the consistency equation (5.18) in a similar fashion. There are 
a couple of key differences to the B case. Firstly, there is now no phase transition 
at fixed B as we vary temperature T. Instead, for very large temperatures ksT ^ Jq, 
the magnetization goes smoothly to zero as 

m — > - — — as J — > oo 

At low temperatures, the magnetization again asymptotes to the state m — > ±1 which 
minimizes the energy. Except this time, there is no ambiguity as to whether the system 
chooses m = -|-1 or m = —1. This is entirely determined by the sign of the magnetic 
field B. 

In fact the low temperature behaviour requires slightly more explanation. For small 
values of B and T, there are again three solutions to (5.18). This follows simply from 
continuity: there are three solutions for T < Tc and B = shown in Figure 44 and these 
must survive in some neighbourhood oi B = 0. One of these solutions is again unstable. 
However, of the remaining two only one is now stable: that with sign(m) = sign(i?). 
The other is meta-stable. We will see why this is the case shortly when we come to 
discuss the free energy. 
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Figure 46: Magnetization with B = Figure 47: Magnetization at B ^ 0. 
and the phase transtion 

The net result of our discussion is depicted in the figures above. When B = 
there is a phase transition at T = T^. For T < T^, the system can sit in one of two 
magnetized states with m — ±too- In contrast, for 5 7^ 0, there is no phase transition 
as we vary temperature and the system has at all times a preferred magnetization 
whose sign is determined by that of B. Notice however, we do have a phase transition 
if we fix temperature at T < and vary B from negative to positive. Then the 
magnetization jumps discontinuously from a negative value to a positive value. Since 
the magnetization is a first derivative of the free energy (5.15), this is a first order 
phase transition. In contrast, moving along the temperature axis at B = results in a 
second order phase transition at T = Tg. 

5.2.2 Critical Exponents 

It is interesting to compare the phase transition of the Ising model with that of the 
liquid-gas phase transition. The two are sketched in the Figure 48 above. In both cases, 
we have a first order phase transition and a quantity jumps discontinuously at T < Tc. 
In the case of the liquid-gas, it is the density p — 1/v that jumps as we vary pressure; 
in the case of the Ising model it is the magnetization m that jumps as we vary the 
magnetic field. Moreover, in both cases the discontinuity disappears as we approach 

We can calculate critical exponents for the Ising model. To compare with our discus- 
sion for the liquid-gas critical point, we will compute three quantities. First, consider 
the magnetization at = 0. We can ask how this magnetization decreases as we tend 
towards the critical point. Just below T = Tc, m is small and we can Taylor expand 
(5.18) to get 

m ~ (3Jqm — - {PJqmf -\- . . . 
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Figure 48: A comparison of the phase diagram for the hquid-gas system and the Ising model. 
The magnetization therefore scales as 

mo~±(re-r)i/2 ^520) 

This is to be compared with the analogous result (5.9) from the van der Waals equation. 
We see that the values of the exponents are the same in both cases. Notice that the 
derivative dm/dT becomes infinite as we approach the critical point. In fact, wc had 
already anticipated this when we drew the plot of the magnetization in Figure 45. 

Secondly, we can sit at T = Tc and ask how the magnetization changes as we approach 
B — 0. We can read this off from (5.18). At T = Tc we have pjq = 1 and the 
consistency condition becomes reads m — ta,nh{B / Jq + m). Expanding for small B 
gives 

B I f B \^ B 1 s ,^/^2x 



m^ — +m \-r+^] + ■ ■ ■ ~ -;- + m m'^ + 0(B^) 

Jq ^ \ J(i J Jq 3 

So we find that the magnetization scales as 

m ~ B^/^ (5.21) 

Notice that this power of 1/3 is again familiar from the liquid-gas transition (5.10) 
where the van der Waals equation gave Vg^s — fiiquid ~ (p — Pc)^^^- 

Finally, we can look at the magnetic susceptibility x, defined as 

dm 

This is analogous to the compressibility k, of the gas. Wc will ask how x changes as wc 
approach T ^ Tc from above at B = 0. We differentiate (5.18) with respect to B to 
get 

X = (i + II^ 

cosh^ j3 J qm \ N 
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We now evaluate this at i? = 0. Since we want to approach T ^ Tc from above, we can 
also set m = in the above expression. Evaluating this at -B = gives us the scaling 

Once again, we see that same critical exponent that the van der Waals equation gave 
us for the gas (5.12). 

5.2.3 Validity of Mean Field Theory 

The phase diagram and critical exponents above were all derived using the mean field 
approximation. But this was an unjustified approximation. Just as for the van der 
Waals equation, we can ask the all-important question: are our results right? 

There is actually a version of the Ising model for which the mean field theory is 
exact: it is the d = oo dimensional lattice. This is unphysical (even for a string 
theorist). Roughly speaking, mean field theory works for large d because each spin has 
a large number of neighbours and so indeed sees something close to the average spin. 

But what about dimensions of interest? Mean field theory gets things most dramati- 
cally wrong in d = 1. In that case, no phase transition occurs. We will derive this result 
below where we briefiy describe the exact solution to the d = 1 Ising model. There is 
a general lesson here: in low dimensions, both thermal and quantum fiuctuations are 
more important and invariably stop systems forming ordered phases. 

In higher dimensions, d > 2, the crude features of the phase diagram, including 
the existence of a phase transition, given by mean field theory arc essentially correct. 
In fact, the very existence of a phase transition is already worthy of comment. The 
defining feature of a phase transition is behaviour that jumps discontinuously as we 
vary (5 or B. Mathematically, the functions must be non-analytic. Yet all properties of 
the theory can be extracted from the partition function Z which is a sum of smooth, 
analytic functions (5.14). How can we get a phase transition? The loophole is that Z is 
only necessarily analytic if the sum is finite. But there is no such guarantee that when 
the number of lattice sites N ^ oo. We reach a similar conclusion to that of Bose- 
Einstein condensation: phase transitions only strictly happen in the thermodynamic 
limit. There are no phase transitions in finite systems. 

What about the critical exponents that we computed in (5.20), (5.21) and (5.22)? It 
turns out that these are correct for the Ising model defined in c? > 4. (We will briefiy 
sketch why this is true at the end of this Chapter). But for = 2 and d = 3, the 
critical exponents predicted by mean field theory are only first approximations to the 
true answers. 
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For d = 2, the exact solution (which goes quite substantially past this course) gives 
the critical exponents to be, 



mo ~ (T, - 

x~(r-7;)-^ 



with = - 

' 8 




with 5 — lb 
7 

with 7 = - 



The biggest surprise is in c? = 3 dimensions. Here the critical exponents are not known 
exactly. However, there has been a great deal of numerical work to determine them. 
They are given by 



But these are exactly the same critical exponents that are seen in the liquid-gas phase 
transition. That's remarkable! We saw above that the mean field approach to the Ising 
model gave the same critical exponents as the van dcr Waals equation. But they are 
both wrong. And they are both wrong in the same, complicated, way! Why on earth 
would a system of spins on a lattice have anything to do with the phase transition 
between a liquid and gas? It is as if all memory of the microscopic physics — the type 
of particles, the nature of the interactions — has been lost at the critical point. And 
that's exactly what happens. 

What we're seeing here is evidence for universality. There is a single theory which 
describes the physics at the critical point of the hquid gas transition, the 3d Ising model 
and many other systems. This is a theoretical physicist's dream! We spend a great 
deal of time trying to throw away the messy details of a system to focus on the elegant 
essentials. But, at a critical point. Nature does this for us! Although critical points 
in two dimensions are well understood, there is still much that we don't know about 
critical points in three dimensions. This, however, is a story that will have to wait for 
another day. 

5.3 Some Exact Results for the Ising Model 

This subsection is something of a diversion from our main interest. In later subsec- 
tions, we will develop the idea of mean field theory. But first we pause to describe 
some exact results for the Ising model using techniques that do not rely on the mean 
field approximation. Many of the results that we derive have broader implications for 
systems beyond the Ising model. 



(5 ^ 0.32 



5Ri4.8 



7 ?» 



1.2 
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As we mentioned above, there is an exact solution for the Ising model in d = 1 
dimension and, when B = 0, in d = 2 dimensions. Here we will describe the d = 1 
solution but not the full d = 2 solution. We will, however, derive a number of results 
for the d — 2 Ising model which, while falling short of the full solution, nonetheless 
provide important insights into the physics. 

5.3.1 The Ising Model in d — 1 Dimensions 

We start with the Ising chain, the Ising model on a one dimensional line. Here we will 
see that the mean field approximation fails miserably, giving qualitatively incorrect 
results: the exact results shows that there are no phase transitions in the Ising chain. 

The energy of the system (5.13) can be trivially rewritten as 

B ^ 



E = - j"^ SiSi+i - — ^(si + Si+i] 



2 

i=i i=i 



We will impose periodic boundary conditions, so the spins live on a circular lattice with 
sn+1 = Si- The partition function is then 

^ ■■■ JJexp f /3JsiSi+i + — (si + Si+i) j (5.23) 

si=±l sjv=±l i=l ^ ^ 

The crucial observation that allows us to solve the problem is that this partition function 
can be written as a product of matrices. We adopt notation from quantum mechanics 
and define the 2x2 matrix, 

{si\T\si+i) = exp ^pjsiSi+i + ^{si + Si+i)^ (5.24) 

The row of the matrix is specified by the value of Sj = ±1 and the column by Sj+i = ±1. 
T is known as the transfer matrix and, in more conventional notation, is given by 



T 



g-/3J qI3J-/3B 



The sums over the spins and product over lattice sites Yii in (5.23) simply tell us 
to multiply the matrices defined in (5.24) and the partition function becomes 



Z = Tr {{s,\T\s2){s2\T\ss) . . . {sn\T\si)) = TVT^ (5.25) 
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where the trace arises because we have imposed periodic boundary conditions. To com- 
plete the story, we need only compute the eigenvalues of T to determine the partition 
function. A quick calculation shows that the two eigenvalues of T are 

A± = e^-^ cosh (5B ± sj e'^P^ cosh^ (5B-2 sinh 2(3 J (5.26) 
where, clearly, A_ < A+. The partition function is then 

Z = A^ + A^ = A^^(l + ^)«A^ (5.27) 



where, in the last step, we've used the simple fact that if A+ is the largest eigenvalue 
then X^/X^ a; for very large N. 

The partition function Z contains many quantities of interest. In particular, we can 
use it to compute the magnetisation as a function of temperature when B — 0. This, 

recall, is the quantity which is predicted to undergo a phase transition in the mean 
field approximation, going abruptly to zero at some critical temperature. In the d — 1 
Ising model, the magnetisation is given by 



1 a log z 

m 



Np dB 



^^,~x;p~dB 



= 

B=0 



We see that the true physics for o? = 1 is very different than that suggested by the 
mean field approximation. When B — 0, there is no magnetisation! While the J term 
in the energy encourages the spins to align, this is completely overwhelmed by thermal 
fluctuations for any value of the temperature. 

There is a general lesson in this calculation: thermal fluctuations always win in one 
dimensional systems. They never exhibit ordered phases and, for this reason, never 
exhibit phase transitions. The mean field approximation is bad in one dimension. 

5.3.2 2d Ising Model: Low Temperatures and Peierls Droplets 

Let's now turn to the Ising model in d — 2 dimensions. We'll work on a square lattice 
and set B — 0. Rather than trying to solve the model exactly, we'll have more modest 
goals. We will compute the partition function in two different limits: high temperature 
and low temperature. We start here with the low temperature expansion. 

The partition function is given by the sum over all states, weighted by e^'^^. At low 
temperatures, this is always dominated by the lowest lying states. For the Ising model. 
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we have 

Z = exp j pj SiSj 

{s,} \ (ij) 

The low temperature hmit is (3 J — > oo, where the partition function can be approxi- 
mated by the sum over the first few lowest energy states. All we need to do is list these 
states. 

The ground states are easy. There are two of them: spins all up or spins all down. 
For example, the ground state with spins all up looks like 

! t t t 
! M t 
t t t t 

Each of these ground states has energy E = Eq = —2NJ. 

The first excited states arise by flipping a single spin. Each spin has g = 4 nearest 
neighbours - denoted by red lines in the example below - each of which leads to an 
energy cost of 2 J. The energy of each first excited state is therefore Ei = Eq + 8 J. 




There are, of course, different spins that we we can flip and, correspondingly, the 
first energy level has a degeneracy of A^. 

To proceed, we introduce a diagrammatic method to list the different states. We 
draw only the "broken" bonds which connect two spins with opposite orientation and, 
as in the diagram above, denote these by red lines. We further draw the flipped spins 
as red dots, the unflipped spins as blue dots. The energy of the state is determined 
simply by the number of red lines in the diagram. Pictorially, we write the first excited 
state as 

• 

E^ = Eo + 8 J 

— • 

Degeneracy = A^ 
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The next lowest state has six broken bonds. It takes the form 

E2 = Eo + 12J 

• I) it • 

Degeneracy = 2N 

where the extra factor of 2 in the degeneracy comes from the two possible orientations 
(vertical and horizontal) of the graph. 



Things are more interesting for the states which sit at the third excited level. These 
have 8 broken bonds. The simplest configuration consists of two, disconnected, flipped 
spins 



Es = Eo + 16J 
Degeneracy = ^N{N — 5) 



(5.28) 



The factor of in the degeneracy comes from placing the first graph; the factor of 
N — 5 arises because the flipped spin in the second graph can sit anywhere apart from 
on the five vertices used in the first graph. Finally, the factor of 1/2 arises from the 
interchange of the two graphs. 



There are also three further graphs with the same energy E^. These are 



E^ = Eq + 16 J 
Degeneracy = 



and 



E3 = Eo + 16 J 
Degeneracy = 2N 
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where the degeneracy comes from the two orientations (vertical and horizontal). And, 
finally, 



^3=^0 + 16 J 

• u m • Degeneracy = 4A^ 

where the degeneracy comes from the four orientations (rotating the graph by 90°). 

Adding all the graphs above together gives us an expansion of the partition function 
in power of e~^'^ ^ 1. This is 

Z = 2e2^^^ (^1 + Ne-'f' + 2Ne-^^^' + ]^{N^ + m)e-^''^' + . . (5.29) 

where the overall factor of 2 originates from the two ground states of the system. 
We'll make use of the specific coefficients in this expansion in Section 5.3.4. Before 
we focus on the physics hiding in the low temperature expansion, it's worth making a 
quick comment that something quite nice happens if we take the log of the partition 
function, 

log Z = log 2 + 2N(3J + A^e"^^-^ + 2Ne-^'^'^-^ + ^A^e"^^^-^ + . . . 

The thing to notice is that the A^^ term in the partition function (5.29) has cancelled 
out and log Z is proportional to A^, which is to be expected since the free energy of 
the system is extensive. Looking back, we see that the A^^ term was associated to the 
disconnected diagrams in (5.28). There is actually a general lesson hiding here: the 
partition function can be written as the exponential of the sum of connected diagrams. 
We saw exactly the same issue arise in the cluster expansion in (2.37). 

Peierls Droplets 

Continuing the low temperature expansion provides a heuristic, but physically intuitive, 
explanation for why phase transitions happen in > 2 dimensions but not in ci = 1. 
As we fiip more and more spins, the low energy states become droplets, consisting of a 
region of space in which all the spins are fiipped, surrounded by a larger sea in which 
the spins have their original alignment. The energy cost of such a droplet is roughly 

E ~ 2JL 
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where L is the perimeter of the droplet. Notice that the energy does not scale as the 
area of the droplet since all spins inside are aligned with their neighbours. It is only 
those on the edge which are misaligned and this is the reason for the perimeter scaling. 
To understand how these droplets contribute to the partition function, we also need to 
know their degeneracy. We will now argue that the degeneracy of droplets scales as 

Degeneracy ~ e"^ 

for some value of a. To see this, consider firstly the problem of a random walk on a 2d 
square lattice. At each step, we can move in one of four directions. So the number of 
paths of length L is 

#paths ~ 4^ = e^>°e4 

Of course, the perimeter of a droplet is more constrained that a random walk. Firstly, 
the perimeter can't go back on itself, so it really only has three directions that it can 
move in at each step. Secondly, the perimeter must return to its starting point after L 
steps. And, finally, the perimeter cannot self- intersect. One can show that the number 
of paths that obey these conditions is 

#paths ~ e"^ 

where log 2 < a < log 3. Since the degeneracy scales as e"^, the entropy of the droplets 
is proportional to L. 

The fact that both energy and entropy scale with L means that there is an interesting 
competition between them. At temperatures where the droplets are important, the 
partition function is schematically of the form 



E 



For large (3 (i.e. low temperature) the partition function converges. However, as the 
temperature increases, one reaches the critical temperature 

2 / 

ksT, ^ — (5.30) 
a 

where the partition function no longer converges. At this point, the entropy wins over 
the energy cost and it is favourable to populate the system with droplets of arbitrary 
sizes. This is the how one sees the phase transition in the partition function. For 
temperature above T^,, the low-temperature expansion breaks down and the ordered 
magnetic phase is destroyed. 
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We can also use the droplet argument to see why phase transitions don't occur in 
d = 1 dimension. On a line, the boundary of any droplet always consists of just 
two points. This means that the energy cost to forming a droplet is always E = 2J, 
regardless of the size of the droplet. But, since the droplet can exist anywhere along the 
line, its degeneracy is N. The net result is that the free energy associated to creating 
a droplet scales as 



and, as N ^ oo, the free energy is negative for any T > 0. This means that the system 
will prefer to create droplets of arbitrary length, randomizing the spins. This is the 
intuitive reason why there is no magnetic ordered phase in the d — 1 Ising model. 

5.3.3 2d Ising Model: High Temperatures 

We now turn to the 2d Ising model in the opposite limit of high temperature. Here we 
expect the partition function to be dominated by the completely random, disordered 
configurations of maximum entropy. Our goal is to find a way to expand the partition 
function in /3 J <^ 1. 

We again work with zero magnetic field, B = and write the partition function as 



F r.2J -keTlogN 




There is a useful way to rewrite e^"^^^^^ which relies on the fact that the product SiSj 
only takes ±1. It doesn't take long to check the following identity: 



= cosh (3 J (1 + SiSj tanh (33) 



Using this, the partition function becomes 





(5.31) 



where the number of nearest neighbours \s q — A for the 2d square lattice. 
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With the partition function in this form, there is a natural expansion which suggests 
itself. At high temperatures j3J <^ 1 which, of course, means that tanh/3J ^ 1. 
But the partition function is now naturally a product of powers of tanh/3J. This is 
somewhat analogous to the cluster expansion for the interacting gas that we met in 
Section 2.5.3. As in the cluster expansion, we will represent the expansion graphically. 

We need no graphics for the leading order term. It has no factors of tanh/5J and is 
simply 



Z ^ (cosh/3J)2^ 1 = 2^(cosh/3J)2^ 

{Si} 



That's simple. 



Let's now turn to the leading correction. Expanding the partition function (5.31), 
each power of tanh/3J is associated to a nearest neighbour pair {ij). We'll represent 
this by drawing a line on the lattice: 

J O Oj — SiSj tanh pj 

But there's a problem: each factor of tanh /3 J in (5.31) also comes with a sum over all 
spins Si and Sj. And these are +1 and —1 which means that they simply sum to zero, 

^SiSj = +1-1-1 + 1 = 

How can we avoid this? The only way is to make sure that we're summing over an even 
number of spins on each site, since then we get factors of sf = 1 and no cancellations. 
Graphically, this means that every site must have an even number of lines attached to 
it. The first correction is then of the form 

= (tanh/3 J)4 siS2 S2Ss S3S4 S4S1 = 2^(tanh/? J)^ 

{Si} 

There are such terms since the upper left corner of the square can be on any one 
of the A^ lattice sites. (Assuming periodic boundary conditions for the lattice). So 
including the leading term and first correction, we have 

Z = 2^(cosh pjf^ (1 + A^(tanh /3 J)^ + . . .) 

We can go further. The next terms arise from graphs of length 6 and the only possibil- 
ities are rectangles, oriented as either landscape or portrait. Each of them can sit on 
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one of N sites, giving a contribution 



= 2N{teinh pjy 



Things get more interesting when we look at graphs of length 8. We have four different 
types of graphs. Firstly, there are the trivial, disconnected pair of squares 



-N(N -5)(tSinh (3 Jf 



Here the first factor of N is the possible positions of the first square; the factor of N — 5 
arises because the possible location of the upper corner of the second square can't be 
on any of the vertices of the first, but nor can it be on the square one to the left of the 

O o n 

upper corner of the first since that would give a graph that looks like which has 

o o o 

three lines coming off the middle site and therefore vanishes when we sum over spins. 
Finally, the factor of 1/2 comes because the two squares are identical. 

The other graphs of length 8 are a large square, a rectangle and a corner. The large 
square gives a contribution 



There are two orientations for the rectangle. Including these gives a factor of 2, 



= 2Ar(tanh/3J)^ 



Finally, the corner graph has four orientations, giving 



= 4A^(tanh/3J)^ 



Adding all contributions together gives us the first few terms in high temperature 
expansion of the partition function 



Z = 2^{cosh(3Jf^(l + iV(tanh/3J)^ + 2iV(tanh/3J)^ 

+ ^{N^ + 9A^)(tanh pjf + . . . ) 



(5.32) 
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There's some magic hiding in this expansion which we'll turn to in Section 5.3.4. First, 
let's just see how the high energy expansion plays out in the d = 1 dimensional Ising 
model. 

The Ising Chain Revisited 

Let's do the high temperature expansion for the d = 1 Ising 
chain with periodic boundary conditions and B — 0. We have the 
same partition function (5.31) and the same issue that only graphs 
with an even number of lines attached to each vertex contribute. 
But, for the Ising chain, there is only one such term: it is the 
closed loop. This means that the partition function is 

Z = 2^ (cosh /3 J)^ (1 + (tanh /? J)^) Figure 49: 

In the limit N ^ oo, (tanh/3J)^ — > at high temperatures and even the contribution 
from the closed loop vanishes. We're left with 

Z = {2 cosh (3 J)^ 

This agrees with our exact result for the Ising chain given in (5.27), which can be seen 
by setting B — in (5.26) so that A+ = 2 cosh /3 J. 

5.3.4 Kramers- Wannier DuaHty 

In the previous sections we computed the partition function perturbatively in two 
extreme regimes of low temperature and high temperature. The physics in the two cases 
is, of course, very different. At low temperatures, the partition function is dominated by 

the lowest energy states; at high temperatures it is dominated by maximally disordered 
states. Yet comparing the partition functions at low temperature (5.29) and high 
temperature (5.32) reveals an extraordinary fact: the expansions are the same! More 
concretely, the two series agree if we exchange 

e-W , — , tanh /3 J (5.33) 

Of course, we've only checked the agreement to the first few orders in perturbation 
theory. Below we shall prove that this miracle continues to all orders in perturbation 
theory. The symmetry of the partition function under the interchange (5.33) is known 
as Kramers- Wannier duality. Before we prove this duality, we will first just assume 
that it is true and extract some consequences. 




- 164 - 



We can express the statement of the duahty more clearly. The Ising model at tem- 
perature P is related to the same model at temperature /3, defined as 

e-2^-^ = tanh/?J (5.34) 

This way of writing things hides the symmetry of the transformation. A little algebra 
shows that this is equivalent to 

sinh 2(3 J ^ 



sinh 2/3 J 

Notice that this is a hot/cold duality. When (3 J is large, is small. Kramers- Wannier 
duality is the statement that, when S = 0, the partition functions of the Ising model 
at two temperatures are related by 

= 2^-^ (cosh (5 J sinh (5JfZ[^] (5.35) 

This means that if you know the thermodynamics of the Ising model at one temperature, 

then you also know the thermodynamics at the other temperature. Notice however, 
that it docs not say that all the physics of the two models is equivalent. In particular, 
when one system is in the ordered phase, the other typically lies in the disordered 
phase. 

One immediate consequence of the duality is that we can use it to compute the 
exact critical temperature T^.. This is the temperature at which the partition function 
in singular in the iV ^ oo limit. (We'll discuss a more refined criterion in Section 
5.4.3). If we further assume that there is just a single phase transition as we vary the 
temperature, then it must happen at the special self-dual point P = P- This is 

keT = ^£ 2.269 J 

log(v^+l) 

The exact solution of Onsager confirms that this is indeed the transition temperature. 
It's also worth noting that it's fully consistent with the more heuristic Peierls droplet 
argument (5.30) since log 2 < \og{\/2 + 1) < log 3. 

Proving the Duality 

So far our evidence for the duality (5.35) lies in the agreement of the first few terms 
in the low and high temperature expansions (5.29) and (5.32). Of course, we could 
keep computing further and further terms and checking that they agree, but it would 
be nicer to simply prove the equality between the partition functions. We shall do so 
here. 
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The key idea that we need can actually be found by staring hard at the various 
graphs that arise in the two expansions. Eventually, you will realise that they are the 
same, albeit drawn differently. For example, consider the two "corner" diagrams 



Q- 



vs 



6- 



o 



-o- 



6 



-6 



The two graphs are dual. The red lines in the first graph intersect the black lines in 
the second as can be seen by placing them on top of each other: 



o- 



6 



The same pattern occurs more generally: the graphs appearing in the low temperature 
expansion are in one-to-one correspondence with the dual graphs of the high tempera- 
ture expansion. Here we will show how this occurs and how one can map the partition 
functions onto each other. 

Let's start by writing the partition function in the form (5.31) that we met in the 
high temperature expansion and presenting it in a slightly different way, 

= ^ JJ (cosh (3 J + SiSj sinh (3 J) 

=En E c,^Apj]is^s,p 

{si} (ij) kij =0,1 

where we have introduced the rather strange variable kij associated to each nearest 
neighbour pair that takes values and 1, together with the functions. 

Co[/3J] = cosh /5 J and Ci[f3J] = sinh (3 J 

The variables in the original Ising model were spins on the lattice sites. The observation 
that the graphs which appear in the two expansions are dual suggests that it might be 
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profitable to focus attention on the links between lattice sites. Clearly, we have one link 
for every nearest neighbour pair. If we label these links by /, we can trivially rewrite 
the partition function as 

fc,=0,l I {si} 

Notice that the strange label kij has now become a variable that lives on the links / 
rather than the original lattice sites i. 

At this stage, we do the sum over the spins Sj. We've already seen that if a given 
spin, say Sj, appears in a term an odd number of times, then that term will vanish when 
we sum over the spin. Alternatively, if the spin Si appears an even number of times, 
then the sum will give 2. We'll say that a given link / is turned on in configurations 
with ki — 1 and turned off when ki — 0. In this language, a term in the sum over spin 
Si contributes only if an even number of links attached to site i are turned on. The 
partition function then becomes 



(5.36) 



Constrained 



Now we have something interesting. Rather than summing over spins on lattice sites, 
we're now summing over the new variables ki living on links. This looks like the 
partition function of a totally different physical system, where the degrees of freedom 
live on the finks of the original lattice. But there's a catch - that big "Constrained" 
label on the sum. This is there to remind us that we don't sum over all ki configurations; 
only those for which an even number of links are turned on for every lattice site. And 
that's annoying. It's telling us that the ki aren't really independent variables. There 
are some constraints that must be imposed. 



o 



S5 



Fortunately, for the 2d square lattice, there is a simple 
way to solve the constraint. We introduce yet more variables, Si 
which, like the original spin variables, take values ±1. However, 
the Si do not live on the original lattice sites. Instead, they live < 
on the vertices of the dual lattice. For the 2d square lattice, the 
dual vertices are drawn in the figure. The original lattice sites 
are in white; the dual lattice sites in black. 

The link variables ki are related to the two nearest spin vari- Figure 50: 

ables Si as follows: 



Si 



-o„ 



k 
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2(1-^1^2) 
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ki5 



ki3 



ku 



1/ 

2(1-^354) 
1 , 

o(l-SlS4) 



Notice that we've replaced four variables ki taking values 0, 1 with four variables Sj 
taking values ihl. Each set of variables gives 2"^ possibilities. However, the map is not 
one-to-one. It is not possible to construct for all values of ki using the parameterization 
in terms of Sj. To see this, we need only look at 



In other words, the number of links that are turned on must be even. But that's exactly 
what we want! Writing the ki in terms of the auxiliary spins Sj automatically solves the 
constraint that is imposed on the sum in (5.36). Moreover, it is simple to check that for 
every configuration {ki} obeying the constraint, there are two configurations of {sj}. 
This means that we can replace the constrained sum over {ki} with an unconstrained 
sum over {si}. The only price we pay is an additional factor of 1/2. 



Finally, we'd like to find a simple expression for Co and Ci in terms of Sj. That's easy 
enough. We can write 



ki2 + ki3 + ku + ki5 = 





Ck[pj] — cosh pj exp {k logtanh /3 J) 

= (sinh/3Jc„sh^7)V^expf-iM,logta„h^J 



Substituting this into our newly re-written partition function gives 
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But this final form of the partition function in terms of the dual spins Si has exactly the 
same functional form as the original partition function in terms of the spins Sj. More 
precisely, we can write 

= 2^-1 (sinh 2/3 J)^Z[^] 

where 

e-2/3^ = tanh/?J 

as advertised previously in (5.34). This completes the proof of Kramers- Wannier duality 
in the 2d Ising model on a square lattice. 

The concept of duality of this kind is a major feature in much of modern theoretical 
physics. The key idea is that when the temperature gets large there may be a different 
set of variables in which a theory can be written where it appears to live at low tem- 
perature. The same idea often holds in quantum theories, where duality maps strong 
coupling problems to weak coupling problems. 

The duality in the Ising model is special for two reasons: firstly, the new variables 
Si are governed by the same Hamiltonian as the original variables Sj. We say that the 
Ising model is self-dual. In general, this need not be the case — the high temperature 
limit of one system could look like the low-temperature limit of a very different system. 
Secondly, the duality in the Ising model can be proven explicitly. For most systems, 
we have no such luck. Nonetheless, the idea that there may be dual variables in other, 
more difficult theories, is compelling. Commonly studied examples include the exchange 
particles and vortices in two dimensions, and electrons and magnetic monopoles in three 
dimensions. 

5.4 Landau Theory 

We saw in Sections 5.1 and 5.2 that the van der Waals equation and mean field Ising 
model gave the same (sometimes wrong!) answers for the critical exponents. This 
suggests that there should be a unified way to look at phase transitions. Such a method 
was developed by Landau. It is worth stressing that, as we saw above, the Landau 
approach to phase transitions often only gives qualitatively correct results. However, its 
advantage is that it is extremely straightforward and easy. (Certainly much easier than 
the more elaborate methods needed to compute critical exponents more accurately). 
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The Landau theory of phase transitions is based around the free energy. We will 
illustrate the theory using the Ising model and then explain how to extend it to different 
systems. The free energy of the Ising model in the mean field approximation is readily 
attainable from the partition function (5.17), 

F = ~^ogZ = hNqm^ - |^ log (2 cosh /3Seff) (5.37) 

So far in this course, we've considered only systems in equilibrium. The free energy, 
like all other thermodynamic potentials, has only been defined on equilibrium states. 
Yet the equation above can be thought of as an expression for F as a function of m. 
Of course, we could substitute in the equihbrium value of m given by solving (5.18), 
but it seems a shame to throw out F{m) when it is such a nice function. Surely we can 
put it to some use! 

The key step in Landau theory is to treat the function F = F{T, V; m) seriously. 
This means that we are extending our viewpoint away from equilibrium states to a 
whole class of states which have a constant average value of m. If you want some words 
to drape around this, you could imagine some external magical power that holds m 
fixed. The free energy F{T, V; m) is then telling us the equilibrium properties in the 
presence of this magical power. Perhaps more convincing is what we do with the free 
energy in the absence of any magical constraint. We saw in Section 4 that equilibrium 
is guaranteed if we sit at the minimum of F. Looking at extrema of F, we have the 
condition 

OF 

— — = ^ m — tanh PBes 
dm 

But that's precisely the condition (5.18) that we saw previously. Isn't that nice! 

In the context of Landau theory, m is called an order parameter. When it takes non- 
zero values, the system has some degree of order (the spins have a preferred direction 
in which they point) while when m — the spins are randomised and happily point in 
any direction. 

For any system of interest. Landau theory starts by identifying a suitable order 
parameter. This should be taken to be a quantity which vanishes above the critical 
temperature at which the phase transition occurs, but is non-zero below the critical 
temperature. Sometimes it is obvious what to take as the order parameter; other times 
less so. For the liquid-gas transition, the relevant order parameter is the difference in 
densities between the two phases, fgas — "fiiquid- For magnetic or electric systems, the 
order parameter is typically some form of magnetization (as for the Ising model) or 
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the polarization. For the Bose-Einstein condensate, superfluids and superconductors, 
the order parameter is more subtle and is related to off-diagonal long-range order in 
the one-particle density matrix^", although this is usually rather lazily simplified to say 
that the order parameter can be thought of as the macroscopic wavefunction 

Starting from the existence of a suitable order parameter, the next step in the Landau 
programme is to write down the free energy. But that looks tricky. The free energy 
for the Ising model (5.37) is a rather complicated function and clearly contains some 
detailed information about the physics of the spins. How do we just write down the 
free energy in the general case? The trick is to assume that we can expand the free 
energy in an analytic power series in the order parameter. For this to be true, the order 
parameter must be small which is guaranteed if we are close to a critical point (since 
m — for T > T^). The nature of the phase transition is determined by the kind of 
terms that appear in the expansion of the free energy. Let's look at a couple of simple 
examples. 

5.4.1 Second Order Phase Transitions 

We'll consider a general system (Ising model; liquid-gas; BEC; whatever) and denote 
the order parameter as m. Suppose that the expansion of the free energy takes the 
general form 

F(T; m) = Fo(T) + a{T)m^ + b{T)m* + ... (5.38) 

One common reason why the free energy has this form is because the theory has a 
symmetry under m —m, forbidding terms with odd powers of m in the expansion. 
For example, this is the situation in the Ising model when B = 0. Indeed, if we 
expand out the free energy (5.37) for the Ising model for small m using coshx ^ 
1 + ^x^ + ^x"^ + . . . and log(l -\-y) ^ jj — + ... we get the general form above with 
explicit expressions for Fq{T), a(T) and b{T), 

FisinAT;m) = -NkBTlog2 + {^{l - JqP)^ m' + (^^^^^^ 



-|- . . . 



The leading term Fo{T) is unimportant for our story. We are interested in how the free 
energy changes with m. The condition for equilibrium is given by 

dF 

But the solutions to this equation depend on the sign of the coefficients a{T) and 



^°See, for example, the book '^Quantum Liquids" by Anthony Leggett 
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Figure 51: Free energy when a{T) > 



Figure 52: Free energy when a(T) < 



b{T). Moreover, this sign can change with temperature. This is the essence of the 
phase transitions. In the following discussion, we will assume that b(T) > for all T. 
(If we relax this condition, we have to also consider the term in the free energy 
which leads to interesting results concerning so-called tri-critical points). 

The two figures above show sketches of the free energy in the case where a(T) > 
and a{T) < 0. Comparing to the explicit free energy of the Ising model, a(T) < 
when T > Tc = Jq/ks and a(T) < when T < T^. When a(T) > 0, we have just 
a single equilibrium solution to (5.39) at m = 0. This is typically the situation at 
high temperatures. In contrast, at a{T) < 0, there are three solutions to (5.39). The 
solution m — clearly has higher free energy: this is now the unstable solution. The 
two stable solutions sit at m = ±mo. For example, if we choose to truncate the free 
energy (5.38) at quartic order, we have 



If a{T) is a smooth function then the equilibrium value of m changes continuously from 
m — when a{T) > to m 7^ at a(T) < 0. This describes a second order phase 
transition occurring at defined by a{Tc) — 0. 

Once we know the equilibrium value of m, we can then substitute this back into 
the free energy F(T;m) in (5.38). This gives the thermodynamic free energy F{T) of 
the system in equilibrium that we have been studying throughout this course. For the 
quartic free energy, we have 



Because a(T^) = 0, the equilibrium free energy F{T) is continuous at T = T^. Moreover, 
the entropy S — —dF/dT is also continuous at T = Tc. However, if you differentiate the 





T>Tc 
T<Tc 



(5.40) 
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equilibrium free energy twice, you will get a term which is generically not vanishing 
at T = Tc. This means that the heat capacity C = TdS/dT changes discontinuously 
at T = Tc, as befits a second order phase transition. A word of warning: if you want to 
compute equilibrium quantities such as the heat capacity, it's important that you first 
substitution in the equilibrium value of m and work with (5.40) rather than i (5.38). 
If you don't, you miss the fact that the magnetization also changes with T. 

We can easily compute critical exponents within the context of Landau theory. We 
need only make further assumptions about the behaviour of a(T) and b{T) in the 
vicinity of Tf.. If we assume that near T — we can write 

b{T)^bo , a{T) ^ ao{T - Tc) (5.41) 

then we have 

which reproduces the critical exponent (5.9) and (5.20) that we derived for the van der 
Waals equation and Ising model respectively. 

Notice that we didn't put any discontinuities into the free energy. Everything in 
F{T; m) was nice and smooth. When Taylor expanded, it has only integer powers of 
m and T as shown in (5.38) and (5.41). But the minima of F behave in a non-analytic 
fashion as seen in the expression for rriQ above. 

Landau's theory of phase transitions predicts this same critical exponent for all values 
of the dimension d of the system. But we've already mentioned in previous contexts 
that the critical exponent is in fact only correct for d > 4. We will understand how to 
derive this criterion from Landau theory in the next section. 

Spontaneous Symmetry Breaking 

As we approach the end of the course, we're touching upon a number of ideas that 
become increasingly important in subsequent developments in physics. We already 
briefly met the idea of universality and critical phenomena. Here I would like to point 
out another very important idea: spontaneous symmetry breaking. 

The free energy (5.38) is invariant under the Z2 symmetry m —>■ —m. Indeed, we 
said that one common reason that we can expand the free energy only in even powers 
of m is that the underlying theory also enjoys this symmetry. But below Tc, the system 
must pick one of the two ground states m = +mQ or m = —mo. Whichever choice it 
makes breaks the Z2 symmetry. We say that the symmetry is spontaneously broken by 
the choice of ground state of the theory. 
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Spontaneous symmetry breaking has particularly dramatic consequences when the 
symmetry in question is continuous rather than discrete. For example, consider a 
situation where the order parameter is a complex number ip and the free energy is given 
by (5.38) with m = (This is effectively what happens for BECs, superfluids and 
superconductors) . Then we should only look at the m > solutions so that the ground 
state has IV'P = +mo. But this leaves the phase of t/j completely undetermined. So 
there is now a continuous choice of ground states: we get to sit anywhere on the circle 
paramctcriscd by the phase of Any choice that the system makes spontaneously 
breaks the U{1) rotational symmetry which acts on the phase of ip. Some beautiful 
results due to Nambu and Goldstonc show that the much of the physics of these systems 
can be understood simply as a consequence of this symmetry breaking. The ideas of 
spontaneous symmetry breaking are crucial in both condensed matter physics and 
particle physics. In the latter context, it is intimately tied with the Higgs mechanism. 

5.4.2 First Order Phase Transitions 

Let us now consider a situation where the expansion of the free energy also includes 
odd powers of the order parameter 

F(T; m) = Fo(T) + a{T)m + a{T)m^ + 7(T)m^ + b{T)m* + ... 

For example, this is the kind of expansion that we get for the Ising model free energy 
(5.37) when -B 7^ 0, which reads 

i^ising(r; m) = -NksTlog 2 + - ^{B + Jqmf + + J^l^f + ■ ■ ■ 

Notice that there is no longer a symmetry relating m — > — m: the B field has a 
preference for one sign over the other. 

If we again assume that h{T) > for all temperatures, the crude shape of the free 
energy graph again has two choices: there is a single minimum, or two minima and a 
local maximum. 

Let's start at suitably low temperatures for which the situation is depicted in Figure 
53. The free energy once again has a double well, except now slightly skewed. The local 
maximum is still an unstable point. But this time around, the minima with the lower 
free energy is preferred over the other one. This is the true ground state of the system. 
In contrast, the point which is locally, but not globally, a minimum corresponds to a 
meta-stable state of the system. In order for the system to leave this state, it must 
first fiuctuate up and over the energy barrier separating the two. 
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Figure 53: The free energy of the Ising model ioi B < 0, B = and B > 0. 



In this set-up, we can initiate a first order phase transition. This occurs when the 
coefficient of the odd terms, a{T) and 7(T) change sign and the true ground state 
changes discontinuously from m < to m > 0. In some systems this behaviour 
occurs when changing temperature; in others it could occur by changing some external 
parameter. For example, in the Ising model the first order phase transition is induced 
by changing B. 



At very high temperature, the double well poten- 
tial is lost in favour of a single minimum as depicted in 
the figure to the right. There is a unique ground state, al- 
beit shifted from m = by the presence of the <y{T) term 
above (which translates into the magnetic field B in the 
Ising model) . The temperature at which the meta-stable 
ground state of the system is lost corresponds to the spin- 
odial point in our discussion of the liquid-gas transition. 

One can play further games in Landau theory, looking at how the shape of the free 
energy can change as we vary temperature or other parameters. One can also use this 
framework to give a simple explanation of the concept of hysteresis. You can learn 
more about these from the links on the course webpage. 

5.4.3 Lee- Yang Zeros 

You may have noticed that the flavour of our discussion of phase transitions is a little 
different from the rest of the course. Until now, our philosophy was to derive everything 
from the partition function. But in this section, we dumped the partition function as 
soon as we could, preferring instead to work with the macroscopic variables such as the 
free energy. Why didn't we just stick with the partition function and examine phase 
transitions directly? 
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The reason, of course, is that the approach using the partition function is hard! In 
this short section, which is somewhat tangential to our main discussion, we will describe 
how phase transitions manifest themselves in the partition function. 

For concreteness, let's go back to the classical interacting gas of Section 2.5, although 
the results we derive will be more general. We'll work in the grand canonical ensemble, 
with the partition function 

Z{z, V,T)^Y1 ^''^(^' ^' ^) = E / n e-^^^<^ ^(^^-) (5.42) 

N N ' •' i 

To regulate any potential difficulties with short distances, it is useful to assume that 
the particles have hard-cores so that they cannot approach to a distance less than tq. 
We model this by requiring that the potential satisfies 

U {r-jk) = for rjk < Tq 

But this has an obvious consequence: if the particles have finite size, then there is a 
maximum number of particles, Ny, that we can fit into a finite volume V. (Roughly 
this number is A^v' ~ ^/^o)- But that, in turn, means that the canonical partition 
function Z{N, V,T) = for > Ny, and the grand partition function Z is therefore 
a finite polynomial in the fugacity z, of order A''^. But if the partition function is a 
finite polynomial, there can't be any discontinuous behaviour associated with a phase 
transition. In particular, we can calculate 

pV = kBT\ogZ (5.43) 

which gives us pV as a smooth function of z. We can also calculate 

d 

N^z— log Z (5.44) 
oz 

which gives us as a function of z. Eliminating z between these two functions (as 
we did for both bosons and fermions in Section 3) tells us that pressure p is a smooth 
function of density N/V. We're never going to get the behaviour that we derived from 
the Maxwell construction in which the plot of pressure vs density shown in Figure 38 
exhibits a discontinous derivative. 

The discussion above is just re-iterating a statement that we've alluded to several 

times already: there are no phase transitions in a finite system. To see the discontinuous 

behaviour, we need to take the hmit V ^ oo. A theorem due to Lee and Yang^^ gives 

us a handle on the analytic properties of the partition function in this limit. 

^"'^This theorem was first proven for the Lsing model in 1952. Soon afterwards, the same Lee and 
Yang proposed a model of parity violation in the weak interaction for which they won the 1957 Nobel 
prize. 
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The surprising insight of Lee and Yang is that if you're interested in phase transitions, 
you should look at the zeros of Z in the complex z-plane. Let's firstly look at these 
when V is finite. Importantly, at finite V there can be no zeros on the positive real axis, 
2; > 0. This follows follows from the defintion of Z given in (5.42) where it is a sum 
of positive quantities. Moreover, from (5.44), we can see that Z is a monotonically 
increasing function of z because we necessarily have N > ^. Nonetheless, Z is a 
polynomial in z of order Ny so it certainly has Ny zeros somewhere in the complex 
z-plane. Since Z'*'{z) — Z{z*), these zeros must either sit on the real negative axis or 
come in complex pairs. 

However, the statements above rely on the fact that 2^ is a finite polynomial. As we 
take the limit F — > 00, the maximum number of particles that we can fit in the system 
diverges, Ny 00, and Z is now defined as an infinite series. But infinite series can do 
things that finite ones can't. The Lee- Yang theorem says that as long as the zeros of Z 
continue to stay away from the positive real axis as V ^ 00, then no phase transitions 
can happen. But if one or more zeros happen to touch the positive real axis, life gets 
more interesting. 

More concretely, the Lee- Yang theorem states: 

• Lee- Yang Theorem: The quantity 



exists for all z > 0. The result is a continuous, non-dccrcasing function of z which 
is independent of the shape of the box (up to some sensible assumptions such as 
Surface Aiea/V ~ V~^^^ which ensures that the box isn't some stupid fractal 
shape). 

Moreover, let R he a. fixed, volume independent, region in the complex z plane 
which contains part of the real, positive axis. If R contains no zero of Z{z, V, T) 
for all 2; e i? then © is a an analytic function of z for all z & R. In particular, all 
derivatives of © are continuous. 

In other words, there can be no phase transitions in the region R even in the V — > 00 
limit. The last result means that, as long as we are safely in a region i?, taking 
derivatives of with respect to z commutes with the limit y — > 00. In other words, we 
are allowed to use (5.44) to write the particle density n — N/V as 
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However, if we look at points z where zeros appear on the positive real axis, then will 
generally not be analytic. If dQ/dz is discontinuous, then the system is said to undergo 
a first order phase transition. More generally, if d"^Q/dz"^ is discontinuous for m = n, 
but continuous for all m < n, then the system undergoes an n*^ order phase transition. 
We won't offer a proof of the Lee- Yang theorem. Instead illustrate the general idea 
with an example. 

A Made-Up Example 

Ideally, we would like to start with a Hamiltonian which exhibits a first order phase 
transition, compute the associated grand partition function Z and then follow its zeros 
as V ^ oo. However, as wc mentioned above, that's hard! Instead we will simply 
make up a partition function Z which has the appropriate properties. Our choice is 
somewhat artificial, 

Z{z,V) = + + 

Here a is a constant which will typically depend on temperature, although we'll suppress 
this dependence in what follows. Also, 

[x] — Integer part of x 

Although we just made up the form of Z, it does have the behaviour that one would 
expect of a partition function. In particular, for finite V, the zeros sit at 

z^-1 and ;2 = e"*(2n+i)/[ai/] n = 0,1, . . . ,[aV] - 1 

As promised, none of the zeros sit on the positive real axis. However, as we increase V, 
the zeros become denser and denser on the unit circle. From the Lee- Yang theorem, 
we expect that no phase transition will occur ior z ^ 1 but that something interesting 
could happen at 2; = 1. 

Let's look at what happens as we send V ^ 00. We have 
e= hm hog Z{z,V) 

V-*oo V 

= lim :i([al^]log(l + z)+log(l + z["^l)) 

{Q;log(l + z) \z\ < 1 

q; log (1 -I- -I- a log 2; 1^1 > 1 

We see that © is continuous for all z as promised. But it is only analytic for \z\ ^ 1. 
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We can extract the physics by using (5.43) and (5.44) to ehminate the dependence 
on z. This gives us the equation of state, with pressure p as a function of n = V jN . 
For \z\ < 1, we have 

p = akBTlogl ne[0,a/2) , p < kBT\og2 

\a — n J 

While for \z\ > 1, we have 

(2an \ 
{2a - ny ) rie{3a/2,2a) , p> ksT log2 

They key point is that there is a jump in particle density of An = a at p = aksT log 2. 
Plotting this as a function oipysv = 1/n, we find that we have a curve that is qualita- 
tively identical to the pressure-volume plot of the liquid-gas phase diagram under the 
co-existence curve. (See, for example, figure 38). This is a first order phase transition. 



5.5 Landau-Ginzburg Theory 

Landau's theory of phase transition focusses only on the average quantity, the order 
parameter. It ignores the fluctuations of the system, assuming that they are negligible. 
Here we sketch a generalisation which attempts to account for these fluctuations. It is 
known as Landau-Ginzburg theory. 

The idea is to stick with the concept of the order parameter, m. But now wc allow 
the order parameter to vary in space so it becomes a function m(r). Let's restrict 
ourselves to the situation where there is a symmetry of the theory m — >• —m so we 
need only consider even powers in the expansion of the free energy. We add to these 
a gradient term whose role is to captures the fact that there is some stiffness in the 
system, so it costs energy to vary the order parameter from one point to another. (For 
the example of the Ising model, this is simply the statement that nearby spins want to 
be aligned). The free energy is then given by 

F[m(r)] = j d'^r [a{T)m^ + h{T)m^ + c{T){Vmf] (5.45) 

where we have dropped the constant Fq{T) piece which doesn't depend on the order 
parameter and hence plays no role in the story. Notice that we start with terms 
quadratic in the gradient: a term linear in the gradient would violate the rotational 
symmetry of the system. 
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We again require that the free energy is minimised. But now F is a functional - it is 
a function of the function m{r). To find the stationary points of such objects we need 
to use the same kind of variational methods that we use in Lagrangian mechanics. We 
write the variation of the free energy as 

(5F = y" (fr [2am 5m + Ahm^ 5m + 2cVm • V5m] 
= j (fr [2am + Ahm^ - 2cV^m] 5m 

where to go from the first line to the second we have integrated by parts. (We need 
to remember that c(T) is a function of temperature but does not vary in space so 
that V doesn't act on it). The minimum of the free energy is then determined by 
setting = which means that we have to solve the Eulcr- Lagrange equations for 
the function m(r), 

cV^m = am + 26m^ (5.46) 

The simplest solutions to this equation have m constant, reducing us back to Landau 
theory. We'll assume once again that a(T) > for T > Tc and a(T) < for T < Tc). 
Then the constant solutions are m = for T < T; and m = ±mo = ±^-a/2h for 
T < Tc- However, allowing for the possibility of spatial variation in the order parameter 
also opens up the possibility for us to search for more interesting solutions. 

Domain Walls 

Suppose that we have T < Tc so there exist two degenerate ground states, m = ±mo. 
We could cook up a situation in which one half of space, say x < 0, lives in the ground 
state m = — mg while the other half of space, a; > lives in m = +mo. This is exactly 
the situation that we already met in the liquid-gas transition and is depicted in Figure 
38. It is also easy to cook up the analogous configuration in the Ising model. The two 
regions in which the spins point up or down are called domains. The place where these 
regions meet is called the domain wall. 

We would like to understand the structure of the domain wall. How does the system 
interpolate between these two states? The transition can't happen instantaneously 
because that would result in the gradient term (Vm)^ giving an infinite contribution 
to the free energy. But neither can the transition linger too much because any point at 
which m(r) differs significantly from the value mo costs free energy from the m^ and 
m^ terms. There must be a happy medium between these two. 
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To describe the system with two domains, m{r) must vary but it need only change 
in one direction: m = m{x). Equation (5.46) then becomes an ordinary differential 



This equation is easily solved. We should remember that in order to have two vacua, 
T < Tc which means that a < 0. We then have 



where mo = \J —ajlh is the constant ground state solution for the spin. As x — > ±00, 
the tanh function tends towards ±1 which means that m — > ±mo. So this solution 
indeed interpolates between the two domains as required. We learn that the width of 
the domain wall is given by ^J—2c/a. Outside of this region, the magnetisation relaxes 
exponentially quickly back to the ground state values. 

We can also compute the cost in free energy due to the presence of the domain wall. 
To do this, we substitute the solution back into the expression for the free energy (5.45). 
The cost is not proportional to the volume of the system, but instead proportional to 
the area of the domain wall. This means that if the system has linear size L then the 
free energy of the ground state scales as L'^ while the free energy required by the wall 
scales only as L'^^^ . It is simple to find the parametric dependence of this domain wall 
energy without doing any integrals; the energy per unit area scales as ^J —ca^ /b. Notice 
that as we approach the critical point, and a — > 0, the two vacua are closer, the width 
of the domain wall increases and its energy decreases. 

5.5.1 Correlations 

One of the most important applications of Landau- Ginzburg theory is to understand 
the correlations between fluctuations of the system at different points in space. Suppose 
that we know that the system has an unusually high fluctuation away from the average 
at some point in space, let's say the origin r = 0. What is the effect of this on nearby 
points? 

There is a simple way to answer this question that requires us only to solve the 
differential equation (5.46). However, there is also a more complicated way to derive 
the same result which has the advantage of stressing the underlying physics and the 
role played by fluctuations. Below we'll start by deriving the correlations in the simple 
manner. We'll then see how it can also be derived using more technical machinery. 



equation. 



(P"m am 2hw? 



dx'^ c c 



m — mo tanh 
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We assume that the system sits in a given ground state, say m — +mo, and imagine 
small perturbations around this. We write the magnetisation as 

m(r) = mo + (5m(r) (5-47) 

If we substitute this into equation (5.46) and keep only terms linear in Sm, we find 

cV dm -\ dm — U 

c 

where we have substituted m^ — —a/2b to get this result. (Recall that a < in 
the ordered phase). We now perturb the system. This can be modelled by putting a 
delta-function source at the origin, so that the above equation becomes 

cV^6m + —6m = — 5^(0) 
c 2c 

where the strength of the delta function has been chosen merely to make the equation 
somewhat nicer. This equation is straightforward to solve. Indeed, it is the same kind of 
equation that we already solved when discussing the Debye-Hiickel model of screening. 
Neglecting constant factors (2's and tt's) it is 

This tells us how the perturbation decays as we move away from the origin. This 
equation has several names, reflecting the fact that it arises in many contexts. In 
liquids, it is usually called the Ornstein-Zernicke correlation. It also arises in particle 
physics as the Yukawa potential. The length scale ^ is called the correlation length 




(5.49) 



The correlation length provides a measure of the distance it takes correlations to decay. 
Notice that as we approach a critical point, a — > and the correlation length diverges. 
This provides yet another hint that we need more powerful tools to understand the 
physics at the critical point. We will now take the first baby step towards developing 
these tools. 

5.5.2 Fluctuations 

The main motivation to allow the order parameter to depend on space is to take into 
the account the effect of fluctuations. To see how wc can do this, we flrst need to think 
a little more about the meaning of the quantity F[m{f)] and what we can use it for. 
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To understand this point, it's best if we go back to basics. We know that the true 
free energy of the system can be equated with the log of the partition function (1.36). 
We'd hke to call the true free energy of the system F because that's the notation that 
we've been using throughout the course. But we've now called the Landau- Ginzburg 
functional F[m{r)\ and, while it's closely related to the true free energy, it's not quite 
the same thing as we shall shortly see. So to save some confusion, we're going to change 
notation at this late stage and call the true free energy A. Equation (1.36) then reads 
A — — UbT log Z, which we write this as 



We would like to understand the right way to view the functional F[m(r)] in this frame- 
work. Here we give a heuristic and fairly handwaving argument. A fuller treatment 
involves the ideas of the renormalisation group. 

The idea is that each microstate \n) of the system can be associated to some specific 
function of the spatially varying order parameter m(r). To illustrate this, we'll talk 
in the language of the Ising model although the discussion generalises to any system. 
There we could consider associate a magnetisation m{r) to each lattice site by simply 
averaging over all the spins within some distance of that point. Clearly, this will only 
lead to functions that take values on lattice sites rather than in the continuum. But if 
the functions are suitably well behaved it should be possible to smooth them out into 
continuous functions m(r) which are essentially constant on distance scales smaller 
than the lattice spacing. In this way, we get a map from the space of microstatcs to 
the magnetisation, \n) ^ m{r). But this map is not one-to-one. For example, if the 
averaging procedure is performed over enough sites, flipping the spin on just a single 
site is unlikely to have much effect on the average. In this way, many microstates map 
onto the same average magnetisation. Summing over just these microstates provides a 
first principles construction of the F[m(r)], 



Of course, we didn't actually perform this procedure to get to (5.45): we simply wrote it 
down the most general form in the vicinity of a critical point with a bunch of unknown 
coefficients a(T), h{T) and c(T). But if we were up for a challenge, the above procedure 
tells us how we could go about figuring out those functions from first principles. More 
importantly, it also tells us what we should do with the Landau- Ginzburg free energy. 
Because in (5.50) we have only summed over those states that correspond to a particular 




n 




(5.50) 



n|m(r) 
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value of m{r). To compute the full partition function, we need to sum over all states. 
But we can do that by summing over all possible values of m(r). In other words, 



This is a tricky beast: it is a functional integral. We are integrating over all possible 
function m{r), which is the same thing as performing an infinite number of integrations. 
(Actually, because the order parameters m(r) arose from an underlying lattice and are 
suitably smooth on short distance scales, the problem is somewhat mitigated). 

The result (5.51) is physically very nice, albeit mathematically somewhat daunting. 
It means that we should view the Landau-Ginzburg free energy as a new effective 
Hamiltonian for a continuous variable m{r). It arises from performing the partition 
function sum over much of the microscopic information, but still leaves us with a final 
sum, or integral, over fluctuations in an averaged quantity, namely the order parameter. 

To complete the problem, we need to perform the function integral (5.51). This 
is hard. (Here "hard" means that the majority of unsolved problems in theoretical 
physics can be boiled down to performing integrals of this type). We will proceed with 
an approximation. As in our discussion of correlations above, we assume that wc sit 
sit in the ground state m = +mo and can consider small thermal fluctuations 6m{r) 
around this state (5.47). We then expand the free energy (5.45) to quadratic order, 
dropping all terms of order 5m^ or higher, 

F[m{r)] — j d'^r [ami + 2amo5m + aSm^ + brriQ + 4:bmlSm + GbmlSm^ + c(V5m)^] 

The constant terms simply reproduce the free energy of the ground state. Importantly, 
the linear terms vanish when we substitute in the value mo = i/— a/26. In fact, this was 
guaranteed to happen: the vanishing of the linear terms is equivalent to the requirement 
that the equation (5.46) is obeyed. We're left just with the quadratic terms. To make 
life easier with minus signs, we define a' — a + 6bml — —2a > and the fluctuation 
contribution to the free energy becomes 



If we now plug this form into the functional integral (5.51), the partition function 




(5.51) 




becomes 




(5.52) 
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Writing the partition function in this form gives us room for optimism. We still have 
to perform a functional integral, but now it's an integral of the Gaussian type. And 
we think that we know how to do Gaussian integrals. The fact that it's a functional 
integral merely means that we have to do an infinite number of them. 

Free Energy 

Before we explain how to perform the integral in (5.52), it's worth pausing to point out 
that this expression clarifies the relationship between the true free energy of the system, 
which we're now calling A and is defined hy Z — e~^^, and the Landau- Ginzburg 
functional F[m(r*)]. If our approximation is good, then the functional integral in (5.52) 
will give an expression that is close to 1. Then we have 

A F[mo] 

reforming the functional integral in (5.52) will give corrections to this result. Including 
terms of order 6m{f)^ and higher will give yet further corrections. 

So, our goal is to now perform the integrals in (5.52). As mentioned above, they 
are Gaussian. But they are complicated somewhat by the presence of the derivative 
operator V in the exponent. But it turns out that this is easy to deal with: we simply 
need to write the fluctuations as a Fourier transform over momentum. If the system 
lives in a box with sides of length L, the Fourier transform is 



— * 

Note that because 5m{r) is real, we must have 5m*^ — 5m_^. The momenta k are 
quantised as 

k — —n 
Ij 

where n has integer valued components. We can always get back to the spatial fluctu- 
ations by taking the inverse Fourier transform. 



k 



Substituting this expression into the free energy, we get 

F[m{r)] = F[mo] + ja^^ [a' - ck ■ k'^ Smj;dm^, j d'^r e^(^+^' 



k k' 
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The integral over space gives the delta-function L'^S{k + k') and we can write the 
fluctuation contribution to the free energy in momentum space as 

F[m{r)] = F[mo\ + ^^(a' + c/c^) 5m^5m_j: 

k 

= F[mo] + + ck'^) 5m^5m*^ 

k 

We substitute this into the partition function (5.52) and change the integration measure 
from Sm{f) to the Fourier mode Sm^. The net result is that the functional integral 

— * 

turns into a standard integral over Smj^ for each value of the momentum k. Morever, 
as promised, each of these integrals is simply Gaussian. Which means that we can do 
them, 

Z ^ -Q y dSmj^dSml exp {-(3{a' + ck'^)5m^5ml) (5.53) 

k 

^ -/3F[mo] TT ^^bT 
k 

This means that we can write the true free energy of the system as 



k 



keT f (fk ^ ( TiksT 



Given the free energy, one usually computes the contribution to the heat capacity due 
to the fluctuations. However, we will instead leave this particular thread hanging and 
instead return to the question of correlations. 



Correlations Revisited 

We are now in a position to once again look at the spatial correlations between fluctu- 
ations. This is information is captured in the correlation function {5m{r) (5m(0)). To 
calculate this, it is convenient to first relate it to an associated correlation function in 
momentum space through the Fourier transform, 

{5m{r) 5mm = ^''^ {^m^k^m,) 

k k' 
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We can compute the correlation in momentum space through the partition function 
(5.53). The relevant integral is 

g-/3F[mo] r 

{Snij^Smj^,) = — — — II / dSmj^„dSm_^„ {Sm^Smp) exp [-^{a' + c{k"y)Sm^„ Sm_^„) 

k" 

a' + ck^ ^+^' 

With this in hand, it is a simple matter to compute the spatial correlations, 

1 4-r 



{5m{r) 5m(0)) = -j^^e 



L'^ ^ a' + cq^ 

k 

d'^k ksT 



{27rY a' + ck^ 



This reproduces the result (5.48), with the correlation length ^ again given by (5.49). 
The Upper Critical Dimension 

One of the advantages of treating the fluctuations correctly using the functional integral 
is that it allows us to learn when they can be safely neglected, so that the mean field 
approach of the Landau- Ginzburg equation (5.46) is sufficient to capture the physics. 
Roughly speaking, we require that the size of the fluctuations over any region of space 
is much smaller than the mean- field value: in other words, (Sm^) <IC (m)^ 

We have already seen that the fluctuations decay after a distance ^, so we can gain 
a measure of their importance if we integrating over a ball of radius ^, namely 



d'^r {Sm{r)Sm{0)) ^ 



2-d 



In order to trust mean flcld theory, we require that this ratio is much less than one. 
This is the Ginzburg criterion. We can anticipate trouble as we approach a critical 
point, for here ^ diverges and mo vanishes. The precise scaling of these two quantities 
is ^ = \J —cj^a and mo = ■\/—a/2h where a —> as we approach the critical point. 

We learn that this ratio vanishes as we approach a critical point in dimensions d > 4. 
It diverges in dimensions d < i. Dimension o? = 4 is referred to as the upper critical 
dimension. Above this, mean fleld theory is trustworthy. Indeed, we mentioned in the 
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discussion of the Ising model that the mean field critical exponents give the correct 
answer only for d > A. Below the upper critical dimension, mean field theory does 
not give quantitatively correct answers. We have to work much harder. But we will 
postpone that hard work for another course. 
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